About

Md Shahbaz Alam is a Lead Data Engineer at Ness Digital Engineering with a career focused on data engineering. He has extensive experience in enabling data and analytics solutions for businesses, with technical expertise in data ingestion, transformation, and data processing using Python with Apache Spark. With a good background in data analytics, Shahbaz is able to make good use of structured queries and Python for business insights. Currently working as a Member Technical Staff L3 at Ness Digital Engineering, Shahbaz has developed optimal data pipelines to ingest data from multiple sources, performed cleansing, validation, transformation, and made it ready to consume for end-users such as BI, AI/ML, and business. He has also developed BOTs to automate eye ball processes to reduce manual efforts and provides solutions on cloud (AWS) to build new data/ETL pipelines. He has developed glue job to establish connection with snowflake and dump data raw data from S3 into landing zone and rest SnowSQL takes care of further processing and maintain processed data into staging layer, curated layer etc. and consume by business, BI team. Shahbaz has worked as a Senior Associate, Data Engineering at Publicis Sapient and as an Associate at JP Morgan. He completed his Bachelor's degree in Computer Science from Birla Institute of Technology and Science, Pilani in 2018 and his High School Diploma in Computer Science from Jamia Millia Islamia in 2015. With a technical skillset that includes Data Engineering, Software Engineer, Spark, Python, AWS, Snowflake, AI, NoSQL, ETL, Big Data, ML, Scala, Azure, Deep Learning, CI/CD, SQL, Hadoop, DevOps, HDFS, Apache Airflow, Data Scientist, Integration, and Web, Shahbaz has a relevant experience of 4.71 years.